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ABSTRACT 

Background Few models of how community mobilisation 
works have been elaborated in the scientific literature, 
and evaluation of the impact of these programmes on 
HIV and other health outcomes is extremely limited. 
Avahan, the India AIDS Initiative, has been implementing 
community mobilisation as part of its prevention 
programming with groups of high-risl< individuals across 
six states since 2005. 

Purpose To articulate a programme theory and 
evaluation framework for evaluation of Avahan's 
approach to community mobilisation among female sex 
workers in four southern states in India. 
Methods The authors use a goal-based evaluation 
approach to describe the programme goals and an 
underlying programme theory that specifies how the 
programme is expected to work. Using multilevel 
structural equation modelling with propensity score 
matching, the evaluation will compare what is observed 
in the data with the predicted relationships specified by 
the model. 

Results The Avahan model of community mobilisation 
posits that meaningful participation in high-risk group 
intervention, structural intervention and organisational 
development activities leads to identification, 
collectivisation and ownership, which in turn leads to 
improved programme outcomes. Strong community 
groups and an enabling environment reinforce social 
norm and behaviour change outcomes and lead to 
sustained impact. 

Discussion Specifying an explicit programme theory can 
aid in the evaluation of complex interventions, especially 
when the evaluation design is observational. In addition 
to articulating Avahan's community mobilisation 
approach in a model that can be tested, we 
recommend some specific measures and methods 
that could be used to improve evaluation efforts in the 
future. 
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There is a high, hard ground where practitioners can 
mal<e effective use of research-based theory and 
technique, and there is a swampy lowland where 
situations are confusing "messes" incapable of 
technical solution. The difficulty is that the 
problems of the high ground, however great their 
technical interest, are often relatively unimportant 
to clients or to the larger society, while in the swamp 
are the problems of greatest human concern. 



Schon, DA (1983). 
York: Basic Books 
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Community mobilisation, broadly defined, has 
been implemented by health and development 
organisations across the globe. Few models of how 
community mobilisation works have been elabo- 
rated in the scientific literature, however, and 
evaluation of the impact of these programmes on 
HIV and other health outcomes is extremely 
limited. Avahan, the India AIDS Initiative, has been 
implementing community mobilisation as part of 
its prevention programming with groups of high- 
risk individuals across six states since 2005^ and 
thus provides a unique opportunity to understand 
and evaluate the effect of community mobilisation 
on HIV prevention behaviours. Because of the scale 
of Avahan and the complexity of the community 
mobilisation process (CMP) itself, however, evalu- 
ation is extremely challenging. Furthermore, 
although significant resources were directed 
towards impact evaluation of the overall initiative, 
understanding how the community mobilisation 
component of the programme contributed to 
prevention outcomes was not included in the 
original evaluation design since this component 
was introduced later in the life cycle of the 
programme.^ In this paper, we describe Avahan's 
approach to community mobilisation among 
female sex workers (FSWs) in four southern states 
in India and outline the programme theory and 
framework for an evaluation of the programme's 
impact on HIV prevention outcomes. 



BACKGROUND 
Community mobilisation 

Community mobilisation has been defined and 
operationalised in a variety of ways and incorpo- 
rates concepts from a range of traditions, including 
Freirean liberatory adult education,^ participatory 
development'' and community psychology.^ Much 
of the work around community mobilisation in 
health uses an empowerment framework with 
the central idea that expanding participation of 
communities in programme efforts leads to em- 
powerment and greater capacity to influence, 
control and sustain conditions that affect their 
lives. Avahan describes community mobilisation as 
the process by which high-risk group members 
"...utilize their intimate knowledge of vulnerability 
to overcome the barriers they face and realize 
reduced HIV risk and greater self-reliance through 
their collective action."^ 
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Community mobilisation has been employed as an interven- 
tion strategy to address a variety of health outcomes around the 
world,*^^ and evaluations have shown promise. Two major 
cluster-randomised controlled trials of facilitated participatory 
action cycles among community groups showed significant 
reductions in neonatal mortality rates in the intervention clus- 
ters compared with control clusters. ' One quasi-experimental 
study of community support systems for birth planning, 
funding of emergency transportation in Bangladesh increased 
knowledge of obstetric danger signs substantially more in the 
intervention community than in the comparison or control 
communities.'^ In Nigeria, a quasi-experimental study of 
a combined community mobilisation, advocacy and mass media 
intervention showed positive changes in knowledge, attitudes 
and intentions towards eliminating female genital cutting in 
intervention versus control communities.'^ On the other hand, 
a quasi-experimental study of community mobilisation for 
schistosomiasis control in Brazil was unable to attribute differ- 
ences between the intervention and comparison villages to the 
community mobilisation intervention (CMI).'^ Of note, some 
studies reporting positive outcomes combined community 
mobilisation with other intervention activities, such as mass 
media campaigns'^ or healthcare facility upgrades," making it 
difficult to isolate the contribution of community mobilisation 
on outcomes. 

Interventions with sex workers 

Studies of peer HIV education interventions with sex workers 
have reported increased HIV knowledge'"* and condom use'^ as 
well as decreased prevalence of STDs''' '^ and HIV'* Increas- 
ingly, community mobilisation is a central tenet within 
comprehensive sex worker programmes,'^ as in Avahan.^ '^ " 
One of the earliest examples, the Sonagachi Project,^" used 
a model called 'community-led structural interventions' (CLSl). 
A controlled trial replicating the CLSI model in two communi- 
ties of West Bengal, India, found that the intervention increased 
consistent condom use in the intervention community,^' as well 
as built social networks and addressed environmental barriers to 
economic vulnerability, relative to the comparison community.^^ 
The Sonagachi Project's CLSI model was a major contributor to 
the Avahan approach, as it combines elements of community 
participation and engagement with structural interventions (SI) 
to create an environment that supports social norm and 
behavioural change. 

Avahan — the India AIDS Initiative 

Avahan was launched in late 2003.' The goal was to halt the 
HIV epidemic in India by rapidly building a scaled HIV 
prevention programme for core and bridge population groups 
across four southern states and two north-eastern states in India 
(combined population of 300 million) representing over 80% of 
the HIV cases in India in 2002.^ Through seven lead imple- 
menting NGO partners, who subgrant to 116 local Indian 
NGOs, the programme had reached over 350000 FSWs and 
100 000 high-risk men who have sex with men and transgenders 
(HR-MSM/TG) with outreach services by December 2008, and 
over 75% of both groups were being contacted monthly by the 
programme. A recent study published in the Lancet concluded 
that over 100000 HIV infections were averted at the population 
level as a result of this first phase of Avahan (2003-2008). 

For core groups (FSA^^ HR-MSM/TG and injection drug users), 
Avahan supports a package of interventions including peer-led 
outreach and education, treatment of sexually transmitted 
infections (STI), referrals for HIV and tuberculosis testing and 



care, and distribution of free prevention commodities (condoms 
and needle/syringe exchange). In addition to these interventions, 
Avahan supports interventions to change the structural envi- 
ronment of core group members' lives, and organisational 
development (OD) activities to build capacity and encourage 
participation, leadership and ownership of community-based 
groups and networks. 

EVALUATION FRAMEWORK 

The challenges to evaluating Avahan's community mobilisation 
approach are substantial and consistent with those facing other 
large-scale public health programmes. In particular, Avahan 
was designed for scale: the explicit intent was to 'saturate 
coverage' of high-risk individuals in the designated high preva- 
lence districts in India, filling gaps in areas where other 
government and NGO efforts were in place, and providing 
intervention services in areas where there were no other HIV 
prevention programmes operating. This was among several 
reasons why there were no planned control or comparison sites 
and no data collection in sites where Avahan was not operating, 
and why data collection was focused on coverage and HIV 
impact measures.^ With this design, it is not possible to draw 
strong causal attributions: we cannot 'prove' that the CMI 
caused the prevention outcomes. 

One commonly accepted evaluation strategy when experi- 
mental or quasi-experimental designs are not possible is 'goal- 
based evaluation', which uses a predetermined set of programme 
goals and an underlying programme theory, usually outlined in 
a logic model, to describe how the programme is expected to 
work.^^ If these relationships and outcomes are observed in the 
data, and other alternative explanations can be reasonably 
eliminated, this provides plausible confirmation that the 
programme was successful. Figure 1 depicts several scenarios 
that might be observed. 

SPECIFYING THE MODEL 

It is not unusual when there are multiple stakeholders in 
a programme to have varying theories about how the programme 
will produce the desired effects. Realistic evaluation^^ suggests 
that the first and most important step in an evaluation is to elicit 
these theories and formalise a model that can be tested in various 
contexts. Therefore, developing the model of how we expected 
community mobilisation in Avahan to work was the first step in 
designing an evaluation of the programme. 
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Figure 1 Understanding evaluation results using a goal-based 
evaluation framework. Adapted from Weiss. 
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A basic assumption underlying the development of the model 
is that we are evaluating a single programme. This does not 
mean that the intervention was implemented uniformly or that 
the context was the same across Avahan. In fact, it was not. 
Rather, the model describes the overall conceptual underpin- 
nings, the programme theory, behind Avahan's community 
mobilisation approach. This model can then be tested in 
multiple contexts, and with other groups of high-risk individ- 
uals, and further refined. Throughout this paper, the term 
'community' is synonymous with 'groups of FSWs who come 
together in programme areas', and the model we propose is 
specific to FSWs. While certain elements of the model may be 
applicable to the other high-risk communities served by Avahan, 
we developed the model with FSW interventions in mind. 

COMMUNITY MOBILISATION: DEFINING THE PROGRAMME 
INTERVENTION AND MECHANISMS OF EFFECT 

There are two ways we refer to community mobilisation in this 
paper: the first corresponds to the 'programme' and the second 
to the 'causal processes' specified in the hypothetical model in 
figure 1. 

First, the programme we wish to evaluate is the CMl — this is 
what the programme does to actively solicit and support full and 
meaningful participation of the high-risk population m the 
intervention activities. Measures of the type and level of 
community participation in intervention activities are what we 
use to assess successful implementation and 'dose' of the CMI 
(described later and shown in table 1). 

The second is the CMP — these are things that occur as a result 
of the CMI (ie, as a result of participation in the intervention 
activities). These are the causal processes we beUeve the 
programme sets in motion, and it is these processes that we 
beUeve lead to the desired programme outcomes. 



The CMI 

Avahan supports a package of intervention activities that have 
been roughly grouped into three categories: high-risk group 
interventions (HRGI) that focus on individual risk reduction 
(eg, condom distribution), SI that focus on vulnerability 
reduction (eg, crisis response teams organised to support sex 
workers when arrested or subjected to violence) and OD 
activities that focus on building the capacity of the community 
to lead and own the programme. In theory, these activities 
could be delivered by the implementing NGOs with little or no 
involvement of the community. What distinguishes the 
community mobilisation component of the Avahan interven- 
tion from a more standard HIV prevention intervention 
package is the intentional engagement of the community in 
these activities as actors, rather than simply as recipients of 
services or as paid staff.^' ^° Although not implemented in 
a strict sequence across all Avahan districts, as the intervention 
unfolds, sex workers are provided support and opportunities to 
participate in increasingly transformational ways,^' from 
conducting community mapping and outreach (micro-plan- 
ning), and participating in project committees, to facilitating 
the management of crisis response teams and taking leadership 
roles in formal community-based organisations. 

The CMP 

The goal of community participation is to mobilise the 
community of sex workers so that they can increasingly 
make decisions, influence their environment and shape their 
lives in ways that support their health and well-being. We 
characterise this process by three overlapping and mutually 
reinforcing stages that reflect the expandmg interpersonal, social 
and political space that sex workers inhabit as mobilisation 
unfolds. 



Table 1 Measures to assess the strength of the community mobilisation intervention at the cluster level^ 



Activities 



lUleasures of community participation f 



High-risk group intervention 
Progrannme penetration 
Programme participation 



Number of HRIs registered under project/number of HRIs registered as CBO members 
Proportion of unpaid HRIs in cluster who participate in programme activities^: 
Proportion of paid HRIs in cluster who participate in programme activities 

Categorisation of the cluster as having low, medium or high participation among unpaid and paid HRIs 
Ratios of unpaid and paid HRIs to all participating 

Whether any HRI takes the lead role in organising the micro-planning activity 
Whether any HRI takes the lead role in analysing the micro-planning data 

Total number of entitlements the programme focuses on in the cluster 
Unmet need for entitlements within the cluster 

Proportion of paid HRI to total number of committee members from cluster who participate on committees 
Proportion of unpaid HRI to total number of committee members from cluster who participate on committees 
Proportion of paid HRIs who serve as main person responding to crises to total number of those responding 
Proportion of unpaid HRIs who serve as main person responding to crises to total number of those responding 
Total number of collective events organised by cluster members 

Ratio of paid and unpaid HRIs who participate in collective action events to total number of HRIs registered in cluster 

Existence of cluster representative on leadership team or governing body 
Categorisation of cluster as having low, medium, high or highest level of participation by paid and unpaid HRIs in the 
nomination process 

Proportion of paid HRIs on the leadership team 
Proportion of unpaid HRIs on the leadership team 
Proportion of unpaid to paid HRIs on the leadership team 

•'Cluster' is a geographic unit at the subdistrict level that represents approximately 250 female sex workers served by the programme. 
fAII measures obtained from the cluster-level community participation sheet (CLCPS). 
f Programme activities include: outreach, advocacy, crisis response and clinic. 

§Committees include: outreach, drop-in center (DIC) management, STI clinic management, crisis response, advocacy and condom. 
CBO, community-based organisation; HRI, high-risk individual; STI, sexually transmitted infections. 



Micro-planning: peer-led outreach 

Structural intervention 
Facilitating access to entitlements 

Functional committees§ 

Crisis response 

Organised collective action 

Organisational development 
Leadership and ownership by CBOs 
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Stage 1 : identification witli others 

The process of community mobilisation begins when sex 
worl<ers see themselves as part of a community. In the early 
stage of the programme, Avahan provided a 'safe space' for sex 
workers to gather. The provision of safe space plays an impor- 
tant role in the process of mobilisation through the creation of 
both physical and social space for meeting, discourse and the 
development of a shared identity.^^ Through identification with 
others, a sex worker begins to form relationships and social ties: 
she begins to feel "I am not alone". This is the beginning of 
empowerment and may affect sex workers' other relationships: 
an increasing sense of individual agency and self-confidence may 
lead to greater exercise of decision-making and power in rela- 
tionships with clients and other partners.^® 

Stage 2: collectivisation 

As social cohesion and connectedness grow, sex workers begin to 
see themselves not just as a loosely connected aggregate of 
individual sex workers but as a group that faces common 
concerns, experiences and needs. A strong sense of collective 
identity is vital to participants' willingness to invest emotionally 
in the larger entity^^ and helps drive participation in mobi- 
lisation efforts. With support from Avahan, this is the point 
when sex workers begin to work together to identify issues that 
they can tackle as a collective and to exercise power as a group to 
influence other actors and processes in the wider community. If 
the groups' actions benefit sex workers, others in the commu- 
nity may see participation in the group as something worth- 
while, further building a sense of collective efficacy.^* Sex 
workers who are either not willing, or not able, to join the group 
may also experience benefits as a result of the community's 
collective action; for example, less violence against sex workers, 
or more accessible services. 

Stage 3: ownership 

Because identification and collectivisation do not automatically 
lead to engagement, leadership and ownership,''^ Avahan's OD 
activities specifically support formalisation and ownership of 
community groups and networks. Community-owned organi- 
sations and networks give sex workers greater power and 



influence: community ownership is a common factor across 
successful case studies of community mobilisation for HIV 
prevention.^^ Furthermore, strong collectives support and rein- 
force changes in the environment that facilitate a higher quality 
of life for sex workers and build organisational resilience to 
threats such as loss of funding, police action and discrimination 
by health workers, leading to sustainability of programme 
activities and outcomes. 

Expected programme outputs 

The model specifies a number of programme outputs that are 
expected to be enhanced by the participation and mobilisation 
of the community, and these enhancements may in turn 
increase programme success. For example, greater community 
participation in outreach activities is expected to lead to greater 
coverage of the population, and more community participation 
in programme oversight is expected to lead to higher quality 
services. Other outputs include greater capacity to manage and 
direct programme activities, to advocate on behalf of the 
community and to lead community groups. 

Expected programme outcomes 

The primary HIV prevention behavioural outcomes established 
for the first 5-year phase of Avahan are consistent condom use 
with clients, regular STI service utilisation and increased 
behavioural norms for safer sex. It is hypothesised that these 
primary behavioural outcomes are reinforced by achievement of 
additional social and environmental outcomes, in particular, the 
presence of an enabling environment and strong community 
groups. As a result of all these factors, we expect longer term 
changes in the environment that reduce risk and vulnerabflity 
(eg, reductions in discrimination in public places, police harass- 
ment, violence against sex workers) and help sustain commu- 
nity organisations (eg, organisational processes that support 
good governance, resource mobilisation and linkages between 
community organisations and larger networks of sex workers). 

Taken as a whole, the model depicted in figure 2 describes the 
following programme theory: 

Meaningful participation in HRGI, SI and OD activities leads 
to identification, collectivisation and ownership, which are 
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associated with increased service coverage and quality, vulnera- 
bility reduction, capacity of community groups and improved 
programme outcomes. Strong community groups and an 
enabling environment reinforce social norm and behaviour 
change outcomes and lead to sustained HIV prevention impact. 

THE PLANNED EVALUATION 

We plan to first test the programme theory model in one state, 
Andhra Pradesh (AP). AP was chosen for the initial evaluation in 
part because the two Avahan implementing partners working 
there (India HIV/ AIDS Alliance and Hindustan Latex Family 
Planning Promotion Trust) were willing to conduct additional 
data collection. We will first evaluate the model using data from 
the Alliance districts, then, if the model is supported by the data, 
we will replicate the evaluation in the other districts. AP has the 
second highest estimated adult HIV prevalence rate in India and 
the highest among the four southern states in which Avahan 
works. Like the other southern states, infection is due largely to 
sexual contact. 

This initial test of the programme theory will focus on three 
main components of the model: the CMI, the CMP and the 
primary behavioural outcomes for the first 5-year phase of 
Avahan. Figure 3 depicts our main hypothesis: higher levels of 
community participation lead to greater mobilisation (identifi- 
cation, collectivisation and ownership), which increases the 
likelihood of positive programme outcomes. This dose— response 
relationship via mediating factors will be analysed within 
a Multilevel Structural Equation Model framework.^' Due to the 
non-randomised nature of these observational data, we will 
adjust the model using propensity scores to reduce the effects of 
selection bias."*" 

We limit the initial evaluation to these key components of the 
model for several reasons. First, a parsimonious model focused 
on the main question — does greater community mobilisation 
improve HIV prevention outcomes — is most likely to be useful 
to programme planners who are pressed to justify the additional 
time and resources associated with community mobilisation. 
Second, we did not include outputs in the evaluation since the 
type, quality and availability of the output measures varied 
greatly across programme components (HRGI, SI and OD) and 
across sites. For example, some of the output measures were 
collected through routine programme monitoring (eg, condoms 
distributed, entitlements obtained), while others were collected 
through extensive qualitative data collection only in selected 
sites (eg, capacity of community groups, organisational 
processes). Finally the longer term outcomes (eg, reduced risk 
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Figure 3 Relationship between tine programme theory and the focus of 
the planned evaluation: key concepts, measures, level and source of 
data. STI, sexually transmitted infections. 



and vulnerability, sustained community structures and 
sustained HIV response) have yet to be fully realised and thus 
cannot be evaluated at this time. 

We use two sources of data for this evaluation: the Cluster- 
Level Community Participation Survey (CLCPS) and the 
Behavioural Tracking Survey Version IV (BTS-IV). Both were 
cross-sectional assessments conducted between December 2010 
and July 2011 in nine of 22 districts in AP, comprising all the 
districts in which the two Avahan partners work. For the initial 
evaluation, data from the five districts served by Alliance will be 
used. This will reduce variability in the intervention due to 
a difference in implementing partners, as well as provide an 
opportunity to validate the model in the other districts as 
a second step. 

Community-level measurement of strength of the intervention: 
the CLCPS 

Table 1 describes the measures we used to assess strength of the 
CMI. Although the BTS-IV included self-reported measures of 
exposure to, and participation in, the programme, to adequately 
address our main evaluation question (ie. Did a greater level of 
community mobilisation lead to improved programme 
outcomes?), it was important to have an independent measure of 
'strength of the intervention'. An independent measure of inter- 
vention strength at the community level will allow us to move 
beyond an individual level only analysis of the effect of self- 
reported exposure to the intervention on outcomes. We define 
'strength' as the type and level of participation of the community 
in the CMI, and we measured it with the CLCPS, a tool based on 
a much longer qualitative measure of the nature, scope and 
character of community mobilisation and organisation."*^ 

The CLCPS provides a profile of community participation in 
the CMI at a subdistrict level, a geographic area we describe as 
a 'cluster'. The 'cluster area' was defined at the level of the NGO 
Staff Outreach Worker (ORW), who is responsible for imple- 
mentation and monitoring of the programme in one or several 
small geographical units within each designated district of AP. 
The ORW supports the work of five high-risk group peer ORWs 
(peers) who each serve an average of 50 FSWs. In each cluster, 
the ORWs were interviewed using a series of questions to 
measure community participation in programme implementa- 
tion, management, decision-making and activities including 
crisis response. The information provided by the ORWs was 
validated by structured interviews and detailed reviews of 
organisational documents. There were a total of 104 clusters in 
the five Alliance districts. 

Data from the CLCPS captured the degree of autonomous 
community planning, implementation and oversight of 
programme activities and the quality of governance processes, 
leadership and ownership. These variables served as the basis for 
constructing a quantitative composite intervention exposure 
variable, which characterises the type and level of community 
participation by subdistrict cluster: we created average scores for 
each item in each geographic cluster, and these scores were then 
combined across several domains to represent the 'strength of the 
intervention' in that cluster The cluster-level scores will allow us 
to look at the relationship between the strength of the inter- 
vention and the outcomes (eg, condom use), as well as the rela- 
tionship between the strength of the intervention and the CMPs 
that we expect to mediate the relationship with outcomes. 

Individual-level measurement: the BTS-IV 

Table 2 (supplementary file) provides details on the measures of 
the CMP, all derived from individual-level self-reported data 
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collected by the BTS-IV survey. These measures capture the 
process of becoming empowered, developing a sense of 
community and perceived solidarity, social cohesion and collec- 
tive ownership. 

The BTS included measures of demographics, socioeconomic 
situation, perceived stigma and discrimination, sex work history, 
condom use, perceived individual and collective agency, partici- 
pation in FSW organisations and events and exposure to the local 
CMI programme.^^ For the BTS-IV, we added time since first 
exposed to the CMI programme, self-efficacy scales for condom 
use and for service utilisation, contraceptive use, a social cohe- 
sion scale (validated for use with sex workers)"*^ and a mental 
health (depression) measure.''^ 

The primary outcome measures to be used for this evaluation 
are also derived from the BTS-IV and include self-reported 
condom use with clients (regular and one-time), STI service 
utilisation and increased behavioural norms for safer sex. 
Behavioural norms are measured by frequency of turning away 
clients when they refuse to use condoms, whether any clients in 
past 7 days did not use a condom, and the proportion of new 
entrants to sex work (<1 year) who report consistent condom 
use or refusing sex because of a client not having, or refusing to 
use, a condom. 

From the same set of subdistrict clusters defined for the 
CLCPS, we randomly sampled individual FSWs for the BTS-IV 
using a two-stage sampling procedure. In the first stage, a fixed 
number of hot spots within each cluster were selected using the 
probability proportional to size procedure.^^ In the second stage, 
we selected participants using either systematic sampling from 
non-public places (eg, brothels) or time— location cluster 
sampling from public places (eg, streets, parks, highways). A 
total of 1986 FSWs participated in the survey in the five Alliance 
districts. 

This unique approach to measuring the strength of the 
intervention by subdistrict cluster, in conjunction with an 
independent survey of sex workers in the cluster, will allow us to 
explore the relationship between the strength of the CMI in the 
cluster and the individual-level measures of the CMPs and 
outcomes captured in the BTS-IV. 

CHALLENGES FOR EVALUATION 

Avahan awarded grants to seven state lead partners, who then 
provided subgrants, management and technical support to local 
NGOs.' This resulted in dozens of local NGOs implementing 
the programme. NGOs varied with respect to skills, experience 
and length of engagement with the high-risk communities; 
some were more comfortable than others with the community 
leading and taking ownership of the programme. This variation, 
in part, will be reflected in our measure of strength of the CMI 
and thus will enable us to explore different 'doses' of the inter- 
vention. Other factors that may have affected programme 
implementation are not measured, however. 

There is also significant geographic and demographic variation 
across Avahan, as well as variation in other features of the 
environment that could have influenced how the programme 
was implemented as well as the likelihood of programme 
success. These threats to validity of the findings are somewhat 
mitigated in this initial evaluation since we have confined it to 
one state. To the extent possible, contextual variables will be 
explicitly modelled or controlled for in analyses, including vari- 
ables such as frequency of travel for sex work, location of sex 
work, debt, other sources of income, density of sex workers and 
duration of the intervention in the cluster. 



Despite the many challenges with this evaluation, a complex 
theory-based meditational model, such as the one we propose, 
tends to reduce the likelihood of chance results compared with 
simpler models since the researcher makes a riskier 'prediction' 
about the specific relationships. Finally, because this is essentially 
an observational study, self-selection bias poses a major threat to 
drawing valid inferences. We use propensity score analysis to 
address this threat, as this method has been shown to remove 
about 90% of the bias resulting from non-randomised selection.'*" 

DISCUSSION 

The planned evaluation is an attempt to articulate some of the 
key features of a large-scale investment in community mobi- 
Usation, and how it may work to expand FSWs abiUty to 
overcome barriers they face and reaUse reduced HIV risk. We do 
so understanding that our methods are limited as much by the 
complex nature of the programme and the mobilisation 
processes themselves as by the design and the data available. 
Our model is a greatly simplified rendering of that complex 
system and set of relationships; we have tried to capture the key 
principles at work in that system and elucidate a few critical 
connections between events and outcomes, so that, if confirmed, 
it might serve a practical purpose. A more nuanced under- 
standing of community mobilisation and how specific contexts 
facilitate or constrain programme implementation and CMP will 
require approaches and methods beyond what is proposed for 
this evaluation. 

We hope by articulating a model of community mobilisation 
and developing measures that buOd on both previous research 



What is already known on this subject 



>■ Community mobilisation has been used as an intervention 
strategy to address a variety of health outcomes around the 
world. 

► Few models of community mobilisation have been elaborated 
in the literature, and evaluation of the impact of community 
mobilisation on health outcomes is extremely limited. 

► Community mobilisation may take many years and can be 
difficult and resource intensive, and thus, understanding what 
the most critical components of community mobilisation are 
and evaluating community mobilisation's relative contribution 
to programme outcomes are important to many stakeholders. 



What this study adds 



► We describe Avahan's approach to community mobilisation 
among FSWs in India. 

► We articulate a programme theory that elaborates on how 
participation in the intervention is expected to lead to 
community mobilisation and ultimately to improved 
programme outcomes. 

► We further outline an evaluation framework for the evaluation 
of this large-scale CMI and describe the methods and 
measures that will be used to assess outcomes. 

► Finally, we note the challenges associated with evaluation of 
complex, dynamic community interventions. 



ii14 



J Epidemiol Community Health 201 2;66:ii9-ii1 5. doi: 1 0. 1 1 36/jech-201 1 -200465 



Research report 



and programme experience, we offer some guidance for others. 
At a minimum, we strongly recommend that programmes 
document community participation in the programme (level, 
scope and nature) from the beginning and aggregate that data at 
a meaningful level to assess strength of the intervention in the 
community over time. Baseline and follow-up surveys of 
intended programme beneficiaries collected in those same areas 
using a multistage sampling approach would then provide 
a stronger evaluation of how, and if, the CMI works to improve 
programme results. While cluster-randomised controlled trials of 
CMls may be feasible and appropriate in some instances, CMls 
are by their very nature complex, dynamic evolving systems that 
disrupt and reshape individual, social and institutional rela- 
tionships in the settings in which they are introduced, and thus, 
we believe that more innovative methods of evaluation are 
needed. To generate evidence that will support the development 
and sustainability of better programmes, we may need to leave 
the hard high ground of the experimental paradigm and learn to 
navigate the swampy lowland. 
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